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We provide a generalized version of the nonlinear small-gain theorem 
for the case of more than two coupled input-to-state stable (ISS) systems. 
For this result the interconnection gains are described in a nonlinear gain 
matrix and the small-gain condition requires bounds on the image of this 
gain matrix. The condition may be interpreted as a nonlinear generaliza- 
tion of the requirement that the spectral radius of the gain matrix is less 
than one. We give some interpretations of the condition in special cases 
covering two subsystems, linear gains, linear systems and an associated 
artificial dynamical system. 
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1 Introduction 

Stability is one of the fundamental concepts in the analysis and design of nonlinear 
dynamical systems. The notions of input-to-state stability (ISS) and nonlinear gains 
have proved to be an efficient tool for the qualitative description of stability of nonlin- 
ear input systems. There are different equivalent formulations of ISS: In terms of JC^ 
and 3Coo functions (see below), via Lyapunov functions, as an asymptotic stability 
property combined with asymptotic gains, and others, see JSI- A more quantitative 
but equivalent formulation, which captures the long term dynamic behavior of the 
system, is the notion of input-to-state dynamical stability (ISDS), see [3]. 
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One of the interesting properties in the study of ISS systems is that under certain 
conditions input-to-state stabihty is preserved if ISS systems are connected in cas- 
cades or feedback loops. In this paper we generahze the existing results in this area. 
In particular, we obtain a general condition that guarantees input-to-state stability 
of a general system described as an interconnection of several ISS subsystems. 

The earliest interconnection result on ISS systems states that cascades of ISS sys- 
tems are again ISS, see e.g., |1 H \12 \ IT^. Furthermore, small-gain theorems for the 
case of two ISS systems in a feedback interconnection have been obtained in [31|lJ[3j. 
These results state in one way or another that if the composition of the gain functions 
of ISS subsystems is smaller than the identity, then the whole system is ISS. 

The papers |S1 S 13 use different approaches to the formulation of small-gain condi- 
tions that yield sufficient stability criteria: In ^ the proof is based on the properties 
of oca and %oo functions. This approach requires that the composition of the gains 
is smaller than the identity in a robust sense, see below for the precise statement. We 
show in Example El that within the context of this approach the robustness condi- 
tion cannot be weakened. The result in that paper also covers practical ISS results, 
which we do not treat here. An ISS-Lyapunov function for the feedback system is 
constructed in [Hj as some combination of the corresponding ISS-Lyapunov functions 
of both subsystems. The key assumption of the proof in that paper is that the gains 
are already provided in terms of the Lyapunov functions, by which the authors need 
not resort to a robust version of the small-gain condition. The proof of the small-gain 
theorem in (Hj is based on the ISDS property and conditions for asymptotic stability 
of the feedback loop without inputs are derived. These results will turn out to be 
special cases of our main result. 

General stability conditions for large scale interconnected systems have been ob- 
tained by various authors in other contexts. In sufficient conditions for the asymp- 
totic stability of a composite system are stated in terms of the negative definiteness 
of some test matrix. This matrix is defined through the given Lyapunov functions 
of the interconnected subsystems. Similarly, in [Hj conditions for the stability of in- 
terconnected systems in terms of Lyapunov functions of the individual systems are 
obtained. 

In Siljak considers structural perturbations and their effects on the stability of 
composite systems using Lyapunov theory. The method is to reduce each subsystem 
to a one-dimensional one, such that the stability properties of the reduced aggregate 
representation imply the same stability properties of the original aggregate system. 
In some cases the aggregate representation gives rise to an interconnection matrix W, 
such that quasi dominance or negative definiteness of W yield asymptotic stability 
of the composite system. 

In 17 small-gain type theorems for general interconnected systems with linear 
gains can be found. These results are of the form that the spectral radius of a gain 
matrix should be less than one to conclude stability. The result obtained here may 
be regarded as a nonlinear generalization in the same spirit. 

In this paper we consider a system which consists of two or more ISS subsystems. 
We provide conditions by which the stability question of the overall system can be 



2 



reduced to consideration of stability of the subsystems. We choose an approach 
using estimates involving 3CL and JCoo functions to prove the ISS stability result for 
general interconnected systems. The generalized small-gain condition we obtain is, 
that for some monotone operator T related to the gains of the individual systems the 
condition 



holds for all s > 0, s 7^ (in the sense of the component- wise ordering of the positive 
orthant). We discuss interpretations of this condition in Section^ 

Although we believe our approach to be amenable to the explicit construction of 
a Lyapunov function given the ISS-Lyapunov functions for the subsystems, so far we 
have been able to prove this only for linear gains. 

While the general problem can be approached by repeated application of the cas- 
cade property and the known small-gain theorem, in general this can be cumbersome 
and it is by no means obvious in which order subsystems have to be chosen to proceed 
in such an iterative manner. Hence an extension of the known small-gain theorem to 
larger interconnections is needed. 

In this paper we obtain this extension for the general case. Further, we show how 
to calculate the gain matrix for linear systems and give some interpretation of our 
result. 

The paper is organized as follows. In SectionElwe introduce notation and necessary 
concepts and state the problem. In particular, we will need some basic properties 
of the positive orthant interpreted as a lattice. In Section 3 we prove the main 
result, which generalizes the known small-gain theorem, and consider the special case 
of linear gains, for which we also construct an ISS-Lyapunov function. In Section ^ 
the small-gain condition of the main result is discussed and we show in which way it 
may be interpreted as an extension of the linear condition that the spectral radius 
of the gain matrix has to be less than one. There we also point out the connection 
to some induced monotone dynamical system. In Section [21 we show how the gain 
matrix can be found for linear systems. We conclude with Section IHl 

2 Problem description 

Notation By x'^ we denote the transpose of a vector x G M". For x, y E M", we use 
the following notation 

X > y ^ Xi > yi, i = 1, . . . ,n , and x > y 44> Xi > yi, i = 1, . . . ,n. (2.2) 

In the following ]R_(_ := [0, oo) and by we denote {x G : x > 0}. For a function 
V : M+ M™ we define its restriction to the interval [si, S2] by 




(1.1) 
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Definition 1. (i) A function 7 : M_|_ — > M_|_ is said to be of class JC if it is continuous, 
increasing and^{0) = 0. It is of class %oo if, in addition, it is proper, i.e., unbounded. 

(a) A function [i : M+ x ]R_|_ is said to be of class 3CiL if, for each fixed t, the 

function (3{-,t) is of class JC and, for each fixed s, the function (3{s, ■) is non-increasing 
and tends to zero for i — > 00. 

Let I • I denote some norm in M", and let in particular | 

■^Imax — max^ \xi\ be the 

maximum norm. The essential supremum norm on essentially bounded functions 
defined on M+ is denoted by || • ||oo. 

Definition 2. Consider a system 

x = f{x,u), xGM",uGM™ 

such that for all initial values xq and all essentially bounded inputs u unique solutions 
exist for all positive times. We denote these solutions by ^(t;xo,u). The system is 
called input to state stable (ISS), if there exist functions (3 of class "KL and 7 of class 
%, such that the inequality 

\i{t-XQ,u)\ </3(|2;o|,t) + 7(!l^iiloo) 
holds for all t > 0, xq & , u : M+ M™" essentially bounded. 

Problem statement Consider n interconnected control systems given by 

xi = fiixi, ...,Xn,u) 

: (2.3) 

Xji — fn (2^1 ) • • • ) Xji, u) 

where Xi G M.^\u G and fi : M^i^i^^^^ — > is continuous and Lipschitz in 
the first n arguments uniformly with respect to u for i = I, . . . ,n. Here Xi is the 
state of the i^^ subsystem, and u is considered as an external control variable. 

We may consider u as partitioned u = (ui, . . . , such that each Ui is the input for 
subsystem i only. Then each fi is of the form . . ,u) = fi{. . . , Pi{u)) = fi{. . . ,Ui) 
with some projection Pj. So without loss of generality we may assume to have the 
same input for all systems. 

We call the i^^ subsystem of (|'2.3|) ISS, if there exist functions Pi of class OC^ and 
7ij,7 of class %, such that the solution Xi(t) starting at Xi{0) satisfies 

n 

< A(|x,(0)|,f) + ^7ii(l|xj[o,t]||oo)+7(ll^l|oo) (2.4) 
i=i 

for all t > 0. 
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For notational simplicity we allow the case jij = and require = for all i. 
The functions and 7 are called (nonlinear) gains. We define T : M" M" by 

(n \ 
^1lj{Sj),...,^7nj{Sj)\ (2.5) 
i=l J=l / 

for s = (si, . . . , Sn)'^ G . We refer to T as the gain matrix, noting that it does not 
represent a linear map. Note that by the properties of 'jij for si,,S2 G we have 
the implication 

SI > S2 r(si) > r(s2), (2.6) 

so that r defines a monotone map. 

Assuming each of the subsystems of (|2.3|l to be ISS, we are interested in conditions 
guaranteeing that the whole system defined hj x = {xj, . . . , x^)^, / = {ff, . . . , /J)^ 
and 

x = f{x,u) (2.7) 

is ISS (from u to x). 

Additional Preliminaries We also need some notation from lattice theory, cf. ^HI 
for example. Although (]R",sup,inf) is a lattice, with inf denoting infimum and sup 
denoting supremum, it is not complete. But still one can define the upper limit for 
bounded functions s : M+ M" by 

limsups(t) := inf sup s(t). 



For vector functions x = {xj , . . . ,x^)-^ : M+ — > such that Xi 

i'^^i = 1, . . . , n and times < ti < ^2 we define 




II ^[tiM II : = 

We will need the following property. 

Lemma 3. Let s : M+ — > M" be continuous and bounded. Then (setting Ni = l) 

limsups(t) = limsup|| S[t/2,oo) || • 

t— >CX> t— >CX) 

Proof. Let limsupf^o^ s(t) =: a G M" and limsup^_^oj3 || s\^t/2,oo) || =: ^ € For 
every e G M", e > (component- wise!) there exist tai^b > such that 

yt>ta: sup s{t) < a + e and V t > 4 : sup || stth 00) || ^ ^ + ^- (2-8) 

t>ta t>tb 
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Clearly we have 

S{t) < II S[t/2,oo) II 

for all t > 0, i.e., a < b. On the other hand s(t) < a + e for t > t implies 
II *[V2,oo) II < a + e for T > 2t, i.e., b < a. This immediately gives a = b, and the 
claim is proved. □ 

Before we introduce the ISS criterion for interconnected systems let us briefly 
discuss an equivalent formulation of ISS. A system 

x = /(x,n), (2.9) 

with / : M^+^ continuous and Lipschitz in x G M^, uniformly with respect to 

u E MJ" , is said to have the asymptotic gain property (AG) , if there exists a function 
lAG £ 3Coo such that for all initial values xq G and all essentially bounded control 
functions n(-) : K+ ^ M^, 

limsup|x(t;xo,n)| < TAcdl-wlloo)- (2.10) 

The asymptotic gain property states, that every trajectory must ultimately stay not 
far from zero, depending on the magnitude of ||tt||oo- 

The system p.9|) is said to be globally asymptotically stable at zero (0-GAS), if 
there exists a jScAS ^ ^-^i such that for all initial conditions xq E 

|x(t;xo,0)I </3GA5(ko|,t)- (2.11) 



Thus 0-GAS holds, if, when the input u is set to zero, the system (|2.9|) is globally 
asymptotically stable at x* = 0. 

By a result of Sontag and Wang ^Hj the asymptotic gain property and global 
asymptotic stability at together are equivalent to ISS. 

3 Main results 

In the following subsection we present a nonlinear version of the small-gain theorem 
for networks. In Subsection 13.21 we restate this theorem for the case when the gains 
are linear functions. Here we also provide a method on how to construct an ISS- 
Lyapunov function for the whole network system from given ISS-Lyapunov functions 
of the subsystems. 

3.1 Nonlinear gains 

We introduce the following notation. For Ui S IKoo, i = 1, . . . , n define D : 
by 

/ (Id + ai)(si) 

D{si,...,snf := ; |. (3.12) 

\ (Id + a„)(s„) 
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Theorem 4 (small-gain theorem for networks). Consider the system H2.3() and 
suppose that each subsystem is ISS, i.e., condition \2.4^ holds for all i = 1, . . . ,n. 
Let r he given by \2.5\) . If there exists a mapping D as in \3.1'J^) . such that 

(roD)(s)^s, VseM^\{0}, (3.13) 

then the system \2. 7| ) is ISS from u to x. 

Remark 5. Although looking very complicated to handle at first sight, condition 
\'J.1'J\) is a straightforward extension of the ISS small-gain theorem of It has 
many interesting interpretations, as we will discuss in Section^ 

The following lemma provides an essential argument in the proof of Theorem [l] 

Lemma 6. Let D he as in and suppose holds. Then there exists a 

if € 3Coo such that for all w,v ^ M" , 

{Id-r){w)<v (3.14) 

implies \w\ < ip{\v\). 

Proof. Fix V G M" . We first show, that for those vu G satisfying (|3.14|) at least 
some components have to be bounded. To this end let 



(D-urHv) 



( ai^('fi) 



and s* := D(r*) 



/ -1, > X (3-15) 



We claim that s > s* implies that w = s does not satisfy ()3.14|) . So let s > s* be 
arbitrary and r = D~^[s) > r* (as G K.^)- For such s we have 

s - D-'^{s) = D{r) - r> D{r*) - r* = v , 

where we have used that {D — Id) G /C^. The assumption that vu = s satisfies (|3.14|) 
leads to 

s<v + T{s) <s- D-^{s) + r(s) , 
or equivalently, < T(s) — D~^(s). This implies for r = D^^(s) that 

r < r o D{r) , 

in contradiction to (|3.13jl . This shows that the set of if G M" satisfying (|3.14jl does 
not intersect the set 

Zi := {w G M+ I u; > s*} . 
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Assume now that w e Wl satisfies (|XTH) . Let := s* . If ^ w, then there 
exists an index set Ii C {1, . . . , n}, such that 

Wi > sj, for i e /i and < , for i e If := {1, . . . , re} \ /i . 

For index sets I and J denote by yj the restriction 

y/ := {yi)iei 

for vectors y € and by Ajj : M.^ the restriction 

^/J := iaij)iGi,j£j 

for mappin gs A = (aij)jjg{i^...^„} : M*;: ^ W]^. 
So from (|3.14p we obtain 



< 



^11 



Hence we have in particular 

V ^ -Li 



(3.16) 



>Id 



Note that T/^/j satisfies (j3.13p with D replaced by Di^. Thus, arguing just as before, 
we obtain, that wi^ > s'j is not possible. Hence some more components of w must 
be bounded. 

We proceed inductively, defining 

with := {1, . . . , n} \ /j+i and 



Obviously this nesting will end after at most re — 1 steps: There exists a maximal 
k < n, such that 

{l,...,re}^/i^...^4/0 



and all components of wj^ are bounded by the corresponding components of Sj^ 
For i = 1, . . . , re define 



k+l 



and 



Ci := max{j G {1, . . . , re} : z G /j} 
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Clearly we have 



w < < [D o {D - Id)-i o (Id + r)]"(i;) 



and the term on the very right hand side does not depend on any particular choice 
of nesting of the index sets. Hence every w satisfying p.l4|l also satisfies 



w<[Do{D- Id)-^ o (Id + r)]" o (|i;| 
and taking the max-norm on both sides yields 

< <^(|^^|max) 



w 



for some function ip of class %oo ■ This completes the proof of the lemma. 



□ 



We proceed with the proof of Theorem [IJ which is divided into two main steps. 
First we establish the existence of a solution of the system (|2.7() for all times t > 0. 
In the second step we establish the ISS property for this system. 

Proof, (of Theorem 0} Existence of a solution for \2. 7| ) for all times: For finite times 
t>Q and for s G W] we introduce the abbreviating notation 



\x{t)\:- 




( Tdl^^lloo) 
\ TdKlloo) 



(3.17) 



(3.18) 



V l3n{Snit) 



Now we can rewrite the ISS conditions (|2.4j) of the subsystems in a vectorized form 
for T > as 

I x{t) I < P{\x{Q) I , r) + r(|| X[o,.] II) + 7"(lklloo) (3.19) 
and taking the supremum on both sides over r E [0, t] we obtain 



(Id - F) 



"[o,t] 



= [0,t] 



< /3(|x(0)|,0)+7"(||tx||oo) 
where we used ()2.6|) . Now by Lemma IHl we find 

||x[o,t]||oo < (^(|^(|x(0)|,0) +7"(||'u||oo)|) =: Soo 



(3.20) 



(3.21) 



for some class % function (/? and all times t > 0. Hence for every initial condition 
and essentially bounded input u the solution of our system ()2.7j) exists for all times 
t > 0, since (j3.21 jl does not depend on t. 

Establishing ISS: We now utilize an idea from [4: Instead of estimating |xi(t)| 
with respect to |xj(0)| in 1)2. 4|) . we can also have the point of view that our trajectory 
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started in Xj(r) at time < t < t and we followed it for some time t — t and reach 
Xi{t) at time t. For r = */2 this reads 

\Xi{t)\ < /3i{\xi{t/2)\,t/2) + ^-fij{\\Xi^[t/2,t]\\oo) +l{u) 

< Pi{Soo,*/2) +^-fij{\\Xi^[t/2,oo)\\oc) +l{u) (3.22) 

= f3i(.Soc,t) +'^jij{\\x^t/2,oo)\\oo) +j{u) (3.23) 

where we again applied H2.6|) to obtain (|3.22|) and defined 

Pi{si,t) := Pi{si,t/2), 

which is of class JCJi. 

To write inequality (|3.23|) in vector form, we define 



(3{s,t) :-- 



( /3i(si,t) \ 



V /3n(s„,t) / 



(3.24) 



for all s G . Denoting by := (sqo, • • • , Sco)"^ we obtain the vector formulation 
of (jT^ as 

I x{t) I < Xslo, + r o II x[,/,,oo) II + 7"(lklloo). (3.25) 

By the boundedness of the solution we can take the upper limit on both sides of 
()3.25|) . By Lemma 121 we have 

limsup|x(t)| =limsup|| X[t/2,oo) || ='-Kx), 

t— >oo i— >oo 

and it follows that 

(Id-r)o/(x) <7"(||7x|loo) 

since lim^^oo /3(sSoi i) = 0. Finally, by LemmalHlwe have 

|;(x)|<<^(|7"(||t^||oc)|) (3.26) 

for some ip of class %oo. But 1)3. 26() is the asymptotic gain property ()2.1U|1 . 

Now 0-GAS is established as follows: First note that for n = the quantity Sqo in 
()3.21|) is a /C function of |x(0)|. So 1)3.21(1 shows (Lyapunov) stability of the system 
in the case it = 0. Furthermore, ()3.2(i|) shows attractivity of x = for the system 
()2.7|) in the case n = 0. This shows global asymptotic stability of x = 0. 

Hence system ()2.7|) is AG and 0-GAS, which together were proved to be equivalent 
to ISS in 15, Theorem 1]. □ 
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3.2 Linear gains and an ISS-Lyapunov version 

Suppose the gain functions 7,^ are all linear, hence F is a linear mapping and H2.5|) 
is just matrix- vector multiplication. Then we have the following 

Corollary 7. Consider n interconnected ISS systems as in the previous section on 
the problem description with a linear 

gain matrix T, such that for the spectral radius pofTwe have 

p{T) < 1. (3.27) 

Then the system defined by \2. 7| ) is ISS from u to x. 

Remark 8. For non-negative matrices T 

it is well known that (see, e.g., 'J^ Theorem 2.1.1, page 26, and Theorem 2.1.11, 
page 28]) 

(i) p{T) is an eigenvalue of T and T possesses a non-negative eigenvector corre- 
sponding to p{T), 

(a) ax < Tx holds for some x £ M" \ {0} if and only if a < p{T). 

Hence p(T) < 1 if and only ifTs^s for all s G M" \ {0}. 

Also, by continuity of the spectrum it is clear that for such r,p(r) < 1, there 
always exists a matrix D = diag{\ + ai, . . . , 1 + a„) with ai > 0,i = 1, . . . ,n, such 
that FDs ^ s for all s G M'J: \ {0}. 

Remark 9. For the case of large-scale interconnected input-output systems a similar 
result exists, which can be found in a monograph by Vidyasagar, cf. fiTt p. 110]. 
It also covers Corollary ^ as a special case. The condition on the spectral radius is 
quite the same, although it is applied to a test matrix, whose entries are finite gains 
of products of interconnection operators and corresponding subsystem operators. 
These gains are non-negative numbers and, roughly speaking, defined as the minimal 
possible slope of affine bounds on the interconnection operators. 

Proof, (of Corollary Ej) The proof is essentially the same as of Theorem ^ but note 
that instead of Lemma IHl we now directly have existence of 

(id-r)~i =id + r + r2 + ... 

since p{T) < 1 and from the power sum expansion it is obvious that (Id— F)"^ is a non- 
decreasing mapping, i.e., ioidi,d2 > Owe have (Id— r)~^(di+(i2) — (Id— r)~^((ii) > 0. 

Thus at the two places where Lemma has been used we can simply apply (Id — 
r)~^ to get the desired estimates. □ 



11 



Construction of an ISS-Lyapunov function There is another approach to describe 
the ISS property via so called ISS-Lyapunov functions, cf. |14| . 

Definition 10. A smooth function V is said to be an ISS-Lyapunov function of the 
system (g^l) x = f{x,u), f : M^+^ if 

(i) V is proper, positive-definite, that is, there exit functions ipi,il^2 of class JCoo 
such that 

i^i{\x\) <V{x) <M\x\), VxGM"^; (3.28) 
(a) there exists a positive-definite function a, a class %-function x, such that 

V{x) > x{\u\) =^ W{x)f{x,u) < -a{\x\). (3.29) 
We call the function x the Lyapunov-gain. 

In case of linear Lyapunov-gains a Lyapunov function for the interconnected system 
can be constructed, given ISS-Lyapunov functions of the subsystems. Note, that this 
time we define the gain matrix T with respect to the Lyapunov-gains 'jij. 

Let Vi{xi), . . . ,Vn{xn) be some ISS-Lyapunov functions of the subsystems (|2.3|) . 
allowing for linear Lyapunov-gains ^ij, i.e., there are some DCqo functions il^ii,ipi2 such 
that 

i^ii{\xi\) <V^{xi) <i;i2{\xi\), XiGM^% (3.30) 
and some positive-definite functions Oj such that 

Vi{xi) > max{max{'yijVj{xj)},-fi{\u\)} =^ ^Vi{xi)fi{xu) < -ai{Vi{xi)). (3.31) 
j 

Consider the positive orthant M" , and let Jlj be the subsets of defined by 

n 

:= \^{vi,...,Vn) eRl: Vi>Y,w}- (3-32) 

j=i 

Note that the boundaries OSlj are hyperplanes in case of linear gains. Now if (|3.27|) 
or equivalently Ts ^ s, Vs € M", s ^ 0, holds for F = {'jij), i,j = 1, . . . ,n, then it 
follows that 

n n 

[JVti = R\\ {0} and Pi f), / 0. (3.33) 

2 = 1 1=1 

The proof is the same as of Proposition 1211 see below. Thus we may choose an s > 
with s G nr=i which implies that 



Si > _ 

3 



^7jjSj, i = 1, . . . ,n; (3.34) 



see Fig. ^ If F is irreducible, then using Perron- Frobenius theory we see that we may 
choose s to be a (positive) eigenvector of F. 
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Figure 1: The sets d^i in M.^ and the eigenvector s. 

Theorem 11. Let Vi be an ISS-Lyapunov function as in of the i*"^ subsystem 

from (|2.3|) . i = 1, . . . , n, and s be a positive vector with (|3.34|) . Then an ISS Lyapunov 
function of the interconnected system (|2.3|) is given by 

. . . , := max (3.35) 

i Si 

Proof. Let 7(|u|) := maxj7j(|u|) which is a 3C class function. In the following we 
show that there exists a positive definite function a such that: 

F(x)>7(|n|) =^ VV{x)f{x,u) <-a{V{x)). (3.36) 

Let Mi be open domains in M" defined by 

Mi:={{vi,...,Vn)£W,: ->max|^U, (3.37) 
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and let Pi be the 2-dimensional planes spanned by s and the i-th axis, i.e. 



^ = ^; VA;,i/a. (3.38) 

Sh Sn J 



Note that V defined by (|3.35jl is continuous in and can only fail to be differentiable 
on the planes Pi. 

Now take any x = (xi, . . . , x„) G with {Vi{xi), . . . , Vn{xn)) € Mi then it follows 
that in some neighborhood [/ of x we have Vix) = for all x e U and 

Vi{xi) > maxl —Vj{xj)\ > max.{'yijVj{xj)} (3.39) 

jyti I Sj ) jjti 

(the last inequality follows from ()3.34|) ). hence by 1)3. 31() . \iV{x) = Vi{xi)/si > ^i{\u\), 
then 

Vy(x)/(x, u) = -VVi{x.i)fi{x, u) < --aiiViixi)) < -d^{V{x)), (3.40) 

where di are positive-definite functions, since Si = const > 0. 

It remains to consider x € M" such that {Vi{xi), . . . , Vn{xn)) € Mi n Mj, where 
V{x) may be not differentiable. 

For this purpose we use some results from |2j. For smooth functions fi, i = 1, . . . ,n 
it follows that f{x,u) = max{/j(x,u)} is Lipschitz and Clarke's subgradient of / is 

i 

given by 

dcifix) = co[ \J VMx,u)], M{x) = {i : fiix,u) = f{x)}, (3.41) 

ieM{x) 

i.e., in our case 

dciVix) = co\-VViix): -Vi{x) = Vix)}. (3.42) 
L Sj Si ) 

Now for every extremal point of dciVix) a decrease condition is satisfied by ()3.4U|1 . 
By convexity, the same is true for every element of dciV{x). Now Theorems 4.3.8 and 
4.5.5 of show strong invariance and attractivity of the set {x : V{x) < 7(11^11)}. 
It follows that V is an ISS-Lyapunov function for the interconnection (|2.3|) . □ 

See also Section lOl for some more considerations into this directions. 



4 Interpretation of the generalized small-gain condition 

In this section we wish to provide insight into the small- gain condition of Theorem |^ 
We first show, that the result covers the known interconnection results for cascades 
and feedback interconnections. We then compare the condition with the linear case. 

Further we state some algebraic and graph theoretical relations and investigate 
some associated artificial dynamical system induced by the gain matrix F. We com- 
plete this section with some geometrical considerations and an overview map of all 
these contiguities. 
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4.1 Connections to known results 



As an easy consequence of Theorem |1] we recover, that an arbitrarily long feed for- 
ward cascade of ISS subsystems is ISS again. If the subsystems are enumerated 
consecutively and the gain function from subsystem j to subsystem i > j is denoted 
by 7ij, then the resulting gain matrix has non-zero entries only below the diagonal. 
For arbitrary a G JCoo the gain matrix with entries 'jij o {Id^^ + a) for i > j and 
for i < j clearly satisfies ()3.13|) . Therefore the feed forward cascade itself is ISS. 

Consider n = 2 in equation 1)2. 3|1 . i.e., two subsystems with linear gains. Then in 
Corollary [7| we have 

712 
721 



r 



7ij e 



and p{T) < 1 if and only if 712721 < 1- Hence we obtain the known small-gain 
theorem, cf. [3] and 

For nonlinear gains and n = 2 the condition (|3.1,3j) in Theorem |3] reads as follows: 
There exist ai, 02 G ^00 such that 

712 o (Id + a2)(s2) \ ( 
721 o (Id + ai)(si) y ^ V S2 

for all (si, ^2)^ £ This is easily seen to be equivalent to 

712 o (Id + 02) o 721 o (Id + ai){s) < s , Vs > 0. 

To this end it suffices to check what happens for to the vector [712 o (Id + a2)(s2), ^2]"^ 
under F along with a few similar considerations. The latter is equivalent to the 
condition in the small-gain theorem of namely, that for some Q!i,a2 G ^00 it 
should hold that 



(Id -hai) 0721 o (Id + 02) 0712(5) < s, Vs>0, (4.43) 

for all s S M+, hence our theorem contains this result as a particular case. 

Example 12. The condition i4-4'^ of ^41 seems to be very similar to the small-gain 
condition 712° 721 (-s) < s of '^51 and however those 7's have some different mean- 
ings in these papers. This similarity raises the question, whether the compositions 
with {Id+ dj), i = 1,2 in \4-4^ or more generally with D in (|3.13|) is necessary. 
The answer is positive. Namely, there is a counterexample providing a system of two 
ISS subsystems with 712 o 721(5) < s (7's are defined as above) which is not ISS. 
Consider the equation 

i; = -hn(l - e""), x(0) = x° e M,u G M. 

Integrating it follows 

x{t) = e-*x° + r e-(*-^)n(T)(l - e'^^^)) dr 
Jo 
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< e"*x° + ||'u||oo(l - e~ll"ll°°) = e-*x° + Tdl^lU), l{s) < s. 
Then for a feedback system 

±1 = -xi + X2(l-e-^2) + u(t), (4.44) 
±2 = -X2 + xi{l - e-""^) + u{t) (4.45) 

we have ISS for each subsystem with Xi{t) < e~*x^ + 7i(||a^j||) + ?/i(||u||), where 
7i(s) < s and hence 71 o 72(5) < s for s > 0, but there is a solution xi = X2 = const, 
i.e., 

xi = —X2e~^^ + n, with u = X2e~^^, 

and xi = X2 can be chosen arbitrary large with u ^ for xi — 00. Hence the 
condition T{s) ^ s, for all s G M" \ {0}, or for two subsystems 712 o 721 (s) < s, for 
all s > Q, is not sufficient for the input-to- state stability of the composite system in 
the nonlinear case. 

4.2 Algebraic Interpretation 

In this subsection we first relate the network small-gain condition H3.13() to well known 
properties of matrices in the linear case. This gives some idea how the new condition 
can be understood and what subtle differences appear in the nonlinear case. Then 
we extend some graph theoretical results for non-negative matrices to nonlinear gain 
matrices. These are needed later on. 

For a start, we discuss some algebraic consequences from (|3.13j) . Recall that for a 
non-negative matrix T the following are equivalent: 

(i) p(r) < 1, 

(ii) Vs G Wl \ {0} -.Ts^s, 

(iii) r*^ 0, for k ^ 00, 

(iv) there exist ai, . . . , a„ > such that Vs € M!f: \ {0}: 

r(/ diag(ai, . . .,an))s ^ s. 

Note that (iv) is the linear version of 1)3. As condition (i) is not useful in the 
nonlinear setting, we have turned to (ii), which we later strengthened to (|3.13)) . 
In the nonlinear case we find the obvious implication: 

Proposition 13. Condition iV. implies that 

T{s) ^ s for any s G M*^ \ {0}. (4.46) 

Proof. By the monotonicity of T it is obvious that (|3.13j) implies (|4.46|) . □ 

Note that the contrary is not true: 
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Example 14. Let 



712 = I(h_ 



■+ 



and 



721 (r) = r(l - e ''). 

Since already limr^oo(7i2 0721 — Id){r) = there are certainly no class Xoo functions 



Remark 15. We like to point out the connections between non-negative matrices, 
our gain matrix and directed graphs. 

A (finite) directed graph G = {V,E} consists of a set V of vertices and a set of 
edges E C V x V . We may identify V = {l,...,n} in case of n vertices. The 
adjacency matrix Aq = (o-ij) of this graph is defined by 



The other way round, given an nx n-matrix A, one defines the graph G{A) = {V, E} 
by V := {l,...,n} and E = {{i,j) (^V xV : Oij ^ 0}. 

There are several concepts and results of (non-negative) matrix theory, which are of 
purely graph theoretical nature. Hence the same can be done for our interconnection 
gain matrix T. We may associate a graph G{T), which represents the interconnections 
between the subsystems, in the same manner, as we would do for matrices. 

We could also use the graph of the transpose of T here for compatibility with our 
previous notation (jij encodes whether or not subsystem j influences subsystem i) and 
the standard notation in graph theory (edge from i to j), then the arrows in GiV) 
would point in the 'right' direction. But this does not affect the following results. 

For instance, we say T is irreducible, if G(r) is strongly connected, that is, for 
every pair of vertices {i,j) there exists a sequence of edges (a pathj connecting vertex 
i to vertex j. Obviously T is irreducible if and only ifT^ is. T is called reducible if 
it is not irreducible. 

The gain matrix T is primitive, if its associated graph Gt '■= G{T) is primitive, 
i.e., there exists a positive integer m such that (Ag^)"^ has only positive entries. 

These definitions and the following important facts can be found in ^ and only 
depend on the associated graph. 

If T is reducible, then a permutation transforms it into a block upper triangular 
matrix. From an interconnection point of view, this splits the system into cascades 
of subsystems each with irreducible adjacency matrix. 

Lemma 16. Assume the gain matrix T is irreducible. Then there are two distinct 
cases: 

a) The gain matrix T = (7jj(-))) where 7ij(-) £ X or = 0, is primitive and 
hence there is a non-negative integer ko such that has elements G X 

for any i,j. 



ai,i =1,2 such that jj.j^ holds. 
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b ) The gain matrix T can be transformed to 



PTP 



( 







V ^.1 



Ax2 

^23 













-l,u 

J 



(4.47) 



using some permutation matrix P, where the zero blocks on the diagonal are 
square and where is of block diagonal form with square primitive blocks on 
the diagonal. 

Proof. Let Aqj, be the adjacency matrix corresponding to the graph associated with 
r. This matrix is primitive if and only if F is primitive. Note that the (i, j')*^ entry 
of A^_^ is zero if and only if the (i, j')*^ entry of is zero. Multiplication of F by a 
permutation matrix only rearranges the positions of the class 3C-functions, hence this 
operation is well defined. From these considerations it is clear, that it is sufficient to 
prove the lemma for the matrix A := Aq^. But for non-negative matrices this result 
is an aggregation of known facts from the theory of non- negative matrices, see, e.g., 
U] or [T]. □ 



4.3 Asymptotic Behavior of F'^ 

A related question to the stability of the composite system (|2.7j) is, whether or not 
the discrete positive dynamical system defined by 

Sk+i=T{sk), A; = 1,2,... (4.48) 

with given initial state sq G is globally asymptotically stable. Under the assump- 
tions we made for Theorem^ this is indeed true for irreducible F. 

Theorem 17. Assume that F is irreducible. Then the system defined by (|4.48)) is 
globally asymptotically stable if and only ifT{s) ^ s for all s G \ {0}. 

The proof will make use of the following result: 

Proposition 18. The condition 

lim T''{s) for any fixed s eR^ (4.49) 

k^oo 

implies ()4.46|) . Moreover if F is irreducible, then both are equivalent. 

Note that the converse implication is generally not true for reducible maps F, such 
that 1)4. 46p holds. See Example 1191 But it is trivially true, if F is linear. 
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Proof. Condition ()4.46|) follows from H4.49|) . since if r(so) > sq for some sq G \{0} 
then r'^(so) > r'^~^(so) > so for k = 2,3, . . .. Hence the sequence {r'^(so)}^Q does 
not converge to 0. 

Conversely, assume that (|4.46() holds and that F is irreducible. 
Step 1. First we prove that for any s G \ {0} 

F'=(s) ^ s, kGN. (4.50) 

Assume there exist some k>l and s^O with F'=(s) > s. Define z eW^ as 

z:= max {F'(s)}-0. 

l=0,...,k-l^ / 

By (j2.Hjl and using T^{s) > s we have 

T(z) > max |F's| = max |F's| > max iF^sj = z. 

1=1,. ..,k 1=0,. ..,k l=0,...,k-l 



This contradicts (|4.46j) . 

Step 2. For any fixed s we prove that limsup;.^^^ lr'^(s)| < oo. By Lemma IT^ 
we have two cases. We only consider case a), then case b) follows with a slight 
modification. 

Assume that s is such that limsup^j^go lr^(s)| = oo. For ti > denote the i^^ 
column of F'^" by 

As has no zero entries, for i = 1, . . . ,n there are Tj E M+ such that 

r(=«(t,)>s for any ti > Ti. (4.51) 
If |r'^(s)| — > oo there exists a ki and an index zi such that 

The vector F'^o or^(s), seen as a sum of columns, is greater than the maximum over 
these columns, i.e., 

r'^^o T^^{s) > maxF(=''(F^^(s),) > v'^^ (T^^ (s),,) 

' (4.52) 

>rf(r,j>.. 

This contradicts Step 1. 

Step 3. So {F'^'(s)}^^^ is bounded for any fixed s € M" . The omega-limit set uj{s) 
is defined by 



uj{s) = "j X I 3 subsequence {kj}j=i 2 

' \ (4.53) 
such that r'^^is) x\. 
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This set is not empty by boundedness of {r'^(s)}^^j^. The following properties 
follow from this definition and boundedness of the set |r'^(s)}^,^-^ : 

Vx € Lli{s) =^ r(x) £ c<j(s), 

Vx G uj{s) 3y G u){s) : T{y) = x. 
I.e., i^{s) is invariant under F. The boundedness of i^{s) allows to define a finite vector 

z = supw(s). 

Then for any x £ i^(s) it follows z > x and hence T{z) > T{x). Let y S ^{s) be such 
that r(x) = y. Then T{z) > y. By the invariance of u){s) it follows that 

r(z) > sup{r(x) I Vx G ^{s)} = z. 

This contradicts 1)4. 46() if z ^ 0, i.e., <-ij(s) = {0}. This is true for any s G . Hence 
(|4.49j) is proved as a consequence of (|4.46jl . provided that T is irreducible. □ 



Example 19. Consider the map T : defined by 

r := 

where for t G M+ 



711 

722 



711 (t) :=t{l-e-') 

and the function 722 is constructed in the sequel. First note that 711 G /Coo fl'^'^ 
711 (*) < t,\/t > 0. Lei {efc}^;^ a strictly decreasing sequence of positive real numbers, 
such that limfc_^oo ^fe = and limx-^oo Ylk=i = 00. For A; = 1, 2, . . . define 

722 (e. + (1 + Y.e,)e~^'^^U^A := e,+i + (1 + ^ 
V j=i ^ i=i 

and observe that 

+ (1 + > £.+1 + (1 + , 

i=i i=i 

since > e^+i for all k = 1,2, .. . and the map t i—>- t ■ e~* is strictly decreasing on 
(1,00). 

Moreover we have by assumption, that 

k-l 

£k + (1 + yej)e~^^+^^=''^^ > 0. 

j=i 
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These facts together imply that 722 may be extrapolated to some ICoo-function, in a 
way such that 722 (i) < t, \/t > holds. 

Note that by our particular construction we have r(s) ^ s for all s G \ {0}. 
Now define s^ £ by 

1 

1 + e-i 



and for k = 1,2, . . . inductively define s^^'^ 
By induction one verifies that 



i + E 



j=i ^3 



By our previous considerations and assumptions we easily obtain that the second 
component of the sequence {s^}^i strictly decreases and converges to zero as k tends 
to infinity. But at the same time the first component strictly increases above any given 
bound. 

Hence we established that T{s) s \/s ^ in general does not imply Vs 7^ 
: r'=(s) ^ as k ^ 00. 

Remark 20. Note that we can even turn the constructed 2x2-T into the null-diagonal 
form, that is assumed in Theorem ^ Using the same notation for 'jij as in Exam- 
ple [Wi we just define 



r := 






711 


id 





711 








id 











722 








722 






and 



1 
1 

1 + e-^ 
1 + e-i 



and easily verify that T'^^s^) does not converge to 0. 

Proof of Theorem \ll\ If H4.48() is asymptotically stable, it is in particular attracted 
to zero, so by Proposition ^1 and irreducibility of V we establish (|4.46|) . 

Conversely assume ()4.46|) . Clearly G M" is an equilibrium point for (|4.48|) and by 
Proposition^lit is globally attractive. It remains to prove stability, i.e., for any e > 
there exists a 5 > such that |so| < 5 implies r'^(so) < £ for all times = 0, 1, 2, . . . 

Given e > we can choose an r G fllLi ^ where is the sphere around of 
radius e in W^. Define 5 by 

6 := sup{d G M+ : s < r Vs G Bd{0)}. 

Here -B(i(0) denotes the ball of radius less than d in M" around the origin with respect 
to the Euclidean norm. Clearly we have r > sq for all |so| < S. Since r G 0?=! 7^ 



we have r > T(r) and therefore r > r(r) > r^(r) > . . . and even r'^(r) — 
by Proposition 1181 

Hence for any sq such that |,so| < S we have r^(r) > r^(so) for all k 
by monotonicity of F and therefrom r'^(so) < e for all k = 0,1,2, .. . 



again 

0,1,2,... 
□ 
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4.4 Geometrical Interpretation 

For the following statement let us define the open domains 




where N = Yl^=i ^ partitioned to (xi, . . . , x„) with xi G R^^i = 1, . . . , n, 

as in (ESI). 

Proposition 21. Condition (j4.46|) is equivalent to 

n n 

\Jn, = R^\ {0} and Pi / 0. (4.54) 

i=l i=l 

Proof. Let s 7^ 0. Formula H4.46() is equivalent to the existence of at least one index 
z G {1, . . . , n} with Sj > X^j^j 7jj(^j)- This proves the first part of (|4.54j) . 

It remains to show, that H4.46() implies HILi ^* 7^ ^- We may restrict ourselves to 
the positive orthant in M", and the sets 



s G 




instead of 0,, i = 1, . . . , n. 

For an index set / we define i?/ = {s G : Sm = for m ^ I}. Note that 
points of Ej can not be in for m ^ I. Consider ilj and fij for any i 7^ j. The 
intersections fij n E^^jy and n E^^ jy of this two domains with the plane E^^jy are 
nonempty. The points of di^i lying in this plane do not belong to fifc for any k ^ j, 
hence they are in Since the domains are open it follows that the intersections 
Cli n 7^ for any i 7^ j. Denote Qij = fij H which has nonempty intersection 
with E^i jy by construction. Take any k 7^ i,j. Consider E^^ jj^y D E^^ jy which has 
non-empty intersection with Clij. Let x G f^ij fl E^^ j i^y. There is some y G E^^ j j^j 
with y ^ Qij (say y G E^f^y). Since E^^ j j^y is convex the segment Iry C E^^ j^i^j, hence 
there is some point z G E^i jj^y belonging to d(lij, i.e., E^i jj^y n is non-empty. 

The points of dQij, which are not in Qi, fij and lying in E^i j i^-^ can not belong to 
fij^, u ^ k. Hence they are in and it follows n H 0^ 7^ 0. By iteration the 
second part of 1)4.54(1 follows. □ 

Let us briefly explain, why the overlapping condition (|4.54j) is interesting: From 
the theory of ISS-Lyapunov functions it is known, that a system of the form ()2.9|) is 
ISS if and only if there exists a smooth Lyapunov function V with the property 

\x\ > 7(|nl) VV{x)f{x,u) < -W{\x\) , 
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for some W ^ fC. In the case of our interconnected system this condition translates 
to the existence of Lyapunov functions Vi for the subsystems i = 1, . . . ,n with the 
property 

\Xi\>^lij{\Xj\)+-i{\u\) ^^^^^ 

^\7Vi{xi)fi{x,u) < -Wi{\xi\), 

Now for u = the condition of H4.55() is simply, that x G fij. Thus the overlapping 
condition states that in each point of the state space one of the Lyapunov functions of 
the subsystems is decreasing. It is an interesting problem if via this an ISS-Lyapunov 
function for the whole system may be constructed. 

A typical situation in case of three one dimensional systems (M'^) is presented on 
the Figure |21 on a plane crossing the positive semi axis. The three sectors are the 
intersections of the fij with this plane. 

4.5 Summary map of the interpretations concerning T 

In Figure |21 we summarize the relations between various statements about F that 
were proved in section [l] 

5 Application to linear systems 

An important special case is, of course, when the underlying systems are linear them- 
selves. Consider the following setup, where in the sequel we omit the external input. 
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at: in (PTTTll • V o !!( 'i\ ^ « 

do ill . L ^ J-y \o 1 'f_ o 






JJ- (ff if r is linear) 








^ ur=i = \ m 




|C if r is linear 






p(r) < 1 





Figure 3: Some implications and equivalences of the generalized small-gain condition. 

All statements are supposed to hold for all s G M" , s 7^ 0. The implication 
denoted by * holds if F is linear or irreducible. 

formerly denoted by n, for notational simplicity. Let 

Xj = AjXj, Xj E R^J , j = 1, . . . ,n (5.56) 

describe n globally asymptotically stable linear systems, which are interconnected by 
the formula 

n 

Xj = AjXj + ^ AjkXk j = l,...,n, (5.57) 
fc=i 

which can be rewritten as 

x={A + A)x, (5.58) 

where A is block diagonal, A = diag(j4j,j = l,...,n), each Aj is Hurwitz (i.e., 
the spectrum of Aj is contained in the open left half plane) and the matrix A = 
(Ajfc) is also in block form and encodes the connections between the n subsystems. 
We suppose that Ajj = for all j. Define the matrix R = {rjk),R £ M"^", by 
rjk ■= ||Ajfc||. For each subsystem, there exist positive constants Mj,Xj, such that 
e^^* < M,e-^J* for all t > 0. 

Define a matrix D G M^j:''" by D := diag(^, j = 1, . . . , n). 
From the last subsection we obtain 

Corollary 22. // p{D ■ R) < 1 then i5.58\) is globally asymptotically stable. 

Note that this is a special case of a theorem, which can be found in Vidyasagar 
da p. 110], see Remark H 

Proof. Denote the initial value by x^. Then by elementary ODE theory we have 

Xj{t) = e^^^x] + V r e^^^^-''^ AjkXk{s)ds (5.59) 
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and by standard estimates 

\xj{t)\ < M,e-^^' + Y,rjkY^\\xk,[o,t]\\- (5.60) 

As one can see from ()5.5U|) . in this case the gain matrix happens to be F = D • i?. □ 

It is noteworthy, that this particular corollary is also a consequence of more general 
and precise results of a recent paper [Hj by Hinrichsen, Karow and Pritchard. 

6 Conclusions 

We considered a composite system consisting of an arbitrary number of nonlinear 
arbitrarily interconnected subsystems, as they arise in applications. 

For this general case we derived a multisystem version of the nonlinear small-gain 
theorem. For the special case of linear interconnection gains this is a special case of a 
known Theorem, cf. jlTi page 110]. We also showed how our generalized small-gain 
theorem for networks can be applied to linear systems. 

Many interesting questions remain, for instance concerning the construction of 
Lyapunov functions in case of nonlinear (Lyapunov-)gain functions. 
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